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"Today's announcement 
reflects OSU's 
commitment to its 
researchers and 
seriousness to lead in AI 
research." 


-Jensen Huang (Oregon State University, '84 B.S. 
and '09 Honorary Ph.D., Electrical Engineering) 
Founder and CEO, NVIDIA 




GPUs in Research 


Mike Bailey, professor of computer science 

• 30 years of experience in the computer graphics 
and high-performance computing worlds. 



Oregon State University 


College of Enginee: 



Amazing advances enabled by GPUs: 

• Animation 

• Art 

• Bioinformatics 

• Data Visualization 

• Machine learning 

• Robotics 

• Simulation 

• Virtual and Augmented Reality 
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Veterinary 

Medicine 


Chris Schultz 


Real-time GPU Volume Rendering 
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Real-time GPU-based Voxelization 



Randy Rauwendaal 










































A Voxel-based Virtual Reality 3D Paint Program 

Richard Cunard, Braxton Cuneo, Chris Bakkom 












Exact Alloc 
Exact Free 
Left Alloc 
Left Lock 
Left Free 
Left Preempt 
Right Alloc 
Right Lock 
Right Free 
Right Preempt 


Braxton Cuneo 


Faster lock-free Buddy Memory 
Management for GPU Applications 
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Performance increased from 11.5 
targets/second to 2,000 
targets/second 


GPU Acceleration of Genome Matching 



Ben Weiss 
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Money doesn’t grow on trees... 
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GPU-Related Subjects 


College of Enginee 

Computer Graphics: OpenGL 

(170 students in Fall Quarter 2019) 

http://cs.oregonstate.edu/~mjb/cs550 

Computer Graphics Shaders 

(110 students in Winter Quarter 2020) 

http://cs.oregonstate.edu/~mjb/cs553 

Vulkan 

(70 students in Winter Quarter 2020) 

http://cs.oregonstate.edu/~mjb/cs519v 

Scientific Visualization 

(80 students in Spring Quarter 2019) 

http://cs.oregonstate.edu/~mjb/cs553 

Parallel Programming: OpenCL and CUDA 

(300 students in Spring Quarter 2019) 

http: / / cs.oregonstate.edu/~mjb/cs575 
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Characterizing Parallel Performance 


"Doing Parallel Programming at all isn't difficult - the trick is doing it we//!" 











































































Ay ' 

v' 7 * Vv v • u^'- 


. y ^vC ;r - 


ifi 


■ ■ 1 t * ' ■ 
&V*. 
8 


mmi-m 


.e;W^ 


..- ■ '. , ' ' " vV -.. 

- •■ ■ ' - V • , v- • ■•• 

" — ■•'■ • •:, ■■■■• •- '• 

' V-. . . , *:. •• ■ : ;•' , 

. « ' ■- • V :•' ■: , \ r 

.;j .■[-■ ' r/ ■ * . ■ • :V : .. > * ■♦!* -\ : : 

•*■;/] J jk>‘ V :V%'\‘T- ' : V' V 7 ' *■ ’•• -V- - '•’•• 

; r, ^ */ , 

^' . -•.■•;•••- --V;■>: , % • • . . 




'.• ■ '''£i'".'>/"' • , ‘ , . A .,;f 1 .\sArtJV 


ililS® 

mmm 


Interoperability between GPU 
Computing and GPU Rendering 


* * A Oregon State University 


GPU particle system: 

Total of 1M particles 

Computed and rendered at a rate of 

3 GigaParticles/second 







Six NVIDIA DGX-2 
systems, each with 
16 Tesla V100 GPUs 

• 5,120 CUDA cores 

• 640 Tensor cores 



Enhancing research and teaching 







MegaMonteCarloTrials/Second 


Oregon State University 


College of Engineering 


Tesla GPU vs. Titan Black 


DGX2 vs. Rabbit for Monte Carlo Calculations 



# of Monte Carlo Trials 
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GPUs in Research 


Mike Bailey 

mjb@cs.oregonstate.edu 



0.2 

Todd Palmer, Professor of Nuclear Engineering 

• 27 years of computational nuclear science in academia, U.S. national labs 


Pseudocolor 
Var: phi 

1 -18.25 

13.69 

9.125 

4.561 
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Advanced computing goes 
hand-in-hand with nuclear science 



Los Alamos Scientific Laboratory, 1945 


Oak Ridge National Laboratory, 2018 
























Exascale computing research in nuclear 



Oregon State University 


College of Enginee 



Reduce margins in the design of advanced 
nuclear reactors 

Drive development of nuclear fusion 
Predictive science for national security 
Materials under extreme conditions 
Radiation in medicine 



ORNL's SHIFT modeling NuScale's SMR 
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Immediate research impact: CeMeNT 


• PSAAP III FIC ($lM/yr, 5 years) 

• Dynamic Monte Carlo neutron transport 



National Nuclear Security Administration 



Oregon State 
University 

NSE, ME, EE, CS 



UNIVERSITY OF 

NOTRE DAME 


AeroE 


NC STATE 

UNIVERSITY 
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Deep learning: 
Solving partial differential equations 


Journal of Computational Physics 378 (2019) 686-707 


Journal of Computational Physics 384 (2019) 270-288 



ELSEVIER 


Contents lists available at ScienceDirect 

Journal of Computational Physics 

www.elsevier.com/locate/jcp 



Contents lists available at ScienceDirect 

Journal of Computational Physics 

www.elsevier.com/locate/jcp 



Physics-informed neural networks: A deep learning N 

framework for solving forward and inverse problems involving ss? 
nonlinear partial differential equations 

M. Raissi a , P. Perdikaris b -* , G.E. Karniadakis' 1 

a Division of Applied Mathematics, Brown University, Providence. Rl. 02912. USA 

b Department of Mechanical Engineering and Applied Mechanics. University of Pennsylvania, Philadelphia. PA, 19104. USA 


Neural-net-induced Gaussian process regression for function 
approximation and PDE solution 

Guofei Pang, Liu Yang, George Em Karniadakis 

Division of Applied Mathematics. Brown University. Providence. Rl 02912. USA 



l ■ Lawrence Livermore 
L-i National Laboratory 
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Artificial neural networks for 
radiation transport on GPUs 
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Reliable, Reproducible Nuclear 
Criticality Safety Analyses 























19 F Elastic [2.479 - 3.0 MeV] 


19 Fn,y [0.025 - 0.1 MeV] 

19 F Inelastic [1.85 - 2.354 MeV] 


19 F n,y [0.1 - 0.4 MeV] 


233 U n,y [6e-06 - 8.1e-06 MeV] 
233 U Total- v [6e-06 - 8.1e-06 MeV] 
233 U n,y [1. 77e-06 - 3e-06 MeV] 
19 F Elastic [1.4- 1.85 MeV] 
232 U Total- v [le-05 - 2.97e-05 MeV] 
233 U Total- v [le-06 - 1.77e-06 MeV] 


233 U n,y [4.75e-06 - 6e-06 MeV] 


19 

F Inelastic [1.4 - 1.85 MeV]| 

16 0 n,y [5e-08 - 7e-08 MeV] 


L9 F Inelastic [0.9 - 1.4 MeV] 


19 F Elastic [0.4 - 0.9 MeV] 


Machine learning explains impact 
of nuclear data on criticality ‘bias’ 


SHAP Values for Most Important Reactions 



8 —6 —4 —2 0 2 4 6 

SHAP value (impact on bias prediction) 
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Nuclear data anomaly 
confirmed by expert analysis 



NATIONAL LABORATORY 

- EST. 1943 - 
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GPUs in Research 


Todd Palmer 

todd.palmer@oregonstate.edu 





Al and Robotics Research 


Alan Fern, Professor of Computer Science 
25 human years of AI research « 222 in AI years 
Field moving faster than ever! 



Machine Common Sense 






Oregon State University 


College of Engineer! 


Collaborative Robotics and 
Intelligent Systems (CoRISI Institute 






Robotics Facility 


28+ Core Faculty (AI, Robotics, Security, Sensors) 
60+ Affiliated Faculty across OSU 
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Collaborative Robotics and 
Intelligent Systems ICoRISI Institute 
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Academic Research in Deep learning Era 


ImageNet Classification 



Natural Language Processing 



AI Beats World Go Champion 



State-of-the-art on established problems 
primarily from industrial labs! 

• Leverage huge data sets 

• Leverage large numbers of GPUs 
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Academic Research in Deep learning Era 


ImageNet Classification 



Natural Language Processing 
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Transformer encoder 
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cf. Peng et al. MegDet: A Large Mini-Batch Object Detector. CVPR 2018 
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Academic Research in Deep learning Era 


AI Beats World Go Champion 


AlphaGo Zero by Google DeepMind learns 
by playing millions of games against itself. 

Cost of Computation ~ $2.9M 



At standard hourly rate. 
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Academic Research in Deep learning Era 


Silicon Valley 



Corvallis, Oregon 



100,000s GPUs 


~0 Llamas 


100s GPUs 
100+ Llamas 
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What is the role of academic Al research? 


Industry Labs 



Raw performance on 
established problems 



Academia 



New Understanding 
New Paradigms 
New Problems 











Image Data 



• Regular N x M Grid Structure 

• Deep Networks exploit regularity! 


Professor Fuxin Li - Computer Vision 


Deep learning on Point Cloud Data 


Point Cloud Data 



• Irregular Structure 

• New challenges for deep learning 
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Deep learning on Point Cloud Data 


Semantic Segmentation 


Plocal- 



PointConv Deep Network 


<8>: matrix multiplication [' j: modified part from Fig. 3(b) 
Q : element-wise product 


Method 

mIoU(%) 

ScanNet [5] 

30.6 

PointNet++ [26] 

33.9 

SPLAT Net [33] 

39.3 

Tangent Convolutions [35] 43.8 

PointConv 

Q 55.6 ) 


With new DGX-2 GPUs 66 . 6 % ! 
(scaled to larger networks) 


Professor Fuxin Li - Computer Vision 
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Good Old-Fashion AI 


Knowledge 
repre stut at ion 


Kensmiing 


Symbolic Representations/Reasoning 


Synergy of New and Old 


Deep Learning 



Continuous Distributed Representations 








Synergy of New and Old 
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Good Old-Fashion AI 




Symbolic Representations/Reasoning 


Deep Learning 



Continuous Distributed Representations 


How can we synergistically combine the strengths of both? 
How can be exploit GPUs on both sides? 
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Deep learning+“Old ATfor 
Reinforcement learning 


Deep Model-Based RL w/ Symbolic Planning 

i i 
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DNN Model 


Symbolic 

Al Planning 
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Scaling to enormous deep 
network models is a challenge 













Runtime Al Planning vs. Model Size 


1 CPU 


26 CPUs 


GPU 


Deep learning+“Old AT for 
Reinforcement learning 


Model Size 

0.1 M 

0.5M 

1M 

16M 

GPU Time 

2s 

3.5 s 

5s 

30 s 

CPU Time 

5 s 

250 s 

520 s 



Enables Learning to Solve Atari 
Games from Raw Pixel Input 
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CASSIE Biped - Agility Robotics 



Collaboration w/ Professor Jonathan Hurst 


learning to Walk 


-like agility , robustness , energy efficiency — in theory 
... traditional control techniques fail 


Train deep network controller 
in simulation (need GPUs!) 



Transfer to real world 
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CASSIE very early in training 
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CASSIE after significant training 
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CASSIE at end of training 
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CASSIE on treadmill with learned controller 
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What is the role of academic Al research? 


Industry Labs 



Raw performance on 
established problems 



Academia 



New Understanding 
New Paradigms 
New Problems 
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What is the role of academic Al research? 


Industry Labs 



Raw Performance on 
Established Problems 


Academia 



New Paradigms 
New Problems 
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GPUs in Research 


Alan Fern 

alan.fern@oregonstate.edu 


COLLEGE OF ENGINEERING 






















